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Most  risk  analyses  begin  by  considering  the 
behavior  of  the  lowest  and  most  detailed  level  of 
all  possible  events  that  can  be  identified  in  the 
system  under  study.  Next,  risk  estimates  are 
made  for  each  event-consequence  relationship 
and  aggregated  upward  to  obtain  a total  risk 
estimate  of  the  process  uider  study.  The 
aggregation  process  propagates  the  errors 
contained  in  the  detailed  risk  analyses,  and  often 
resilts  in  risk  estimates  whose  error  ranges  are 
too  wide  to  provide  usefii  information.  An 
alternative  approach  starts  at  the  highest  level 
of  the  problem,  and  identifies  the  crucial 
decisions,  decision  makers,  alternatives  and 
parameters.  Agreements  regarding  specific 
decisions  and  subsequent  actions  are  sought  at 
the  beginning,  and  /What  if*51  situations  and 
conflicts  are  identified  incase  agreement  cannot 
be  reached.  The -"what  if*  situations  provide  the 
framework  for  more  detailed  and  focused  studies 
in  critical  areas.  A variety  of  analyses,  such  as  a 
localized  version  of  the  bottom  up  ..sk  analysis 
approach  and  sensitivity  analysis,  focus  on  these 
open  ended  cases  to  resolve  them.  Unresolvable 
decision  conflicts  include  value  judgments  which 
risk  analysis  cannot  solve;  however,  by  making 
these  conflicts  visible,  the  focus  on  differences 
such  as  these  can  often  force  resolution  at  a 
higher  management  level.  ^ 

Definitions 

Several  definitions  shoild  be  provided  as  a basis 
for  discussion: 

Risk:  The  downside  of  a gamble;  the  potential 
for  harm. 


Bottom-up  Risk  Analysis:  Taking  each  event 

that  can  occur  in  a system  and  analyzing  the 
pathways  leading  to  the  range  of  possible 
consequences,  and  aggregating  these  over  the 
total  spectrum  of  events  and  their  associated 
probabilities. 

Top-down  Risk  Analysis:  Determining  the 

critical  parameters  of  a decision  andfordng  the 
underlying  factors  among  alternative  choices  to 
become  visible  and  understandable. 

Joint  Approach:  Using  a top-down  approach  to 
scope  a problem  and  specific  bottom-up 
approaches  to  provide  quantification  where 
needed. 

In  order  to  illustrate  these  approaches,  a 
hazardous  waste  disposal  example  is  provided. 
Two  different  cases  are  shown  because  they  each 


illifitrate  the  methodologies,  as  well  as  represent 
actual  cases. 


Bottom-Up  Risk 
Material  Site 


Hazrdous 


Consider  an  inactive  waste  dsposal  site  owned 
by  a corporation,  which  is  suddenly  suspected  of 
containing  previously  unidentified  hazardous 
wastes  (as  defined  by  the  Resource  Conservation 
and  Recovery  Act  of  1976  (RCRA)).  The  case 
under  consideration  is  an  actual  case  which  has 
been  modified  for  lb  a as  an  illustration  here. 
Identifying  the  case  is  not  important,  nor  are  the 
condisions  <4- awn  necessarily  valid  for  the 
particular  case  in  question. 

An  old,  uncontrolled  disposal  site  on  a farm  in 
the  midwestern  United  States,  consisting  of  an 
unlined  pit  in  which  an  estimated  ISO  drums  of 
waste  material  were  buried  arotxid  1970,  was 
brought  to  the  attention  of  EPA  EPA 
performed  a two- week  field  study  .from  which 
they  determined  that  the  wastes  came  from  a 
company-owned  hexachlorophene  manufacturing 
process  and  which  contained  2,3,7, 8 
tetrachlorodbenzo-p-doxin  (TCDD)  as  well  as 
other  materials,  such  as  trichlorophenol  (TCP) 
and  ethyleneglycol.  Bore  hdes  were  taken  to 
determine  leakage,  and  the  dsposal  pit  was 
partially  excavated,  uncovering  13  dims  —some 
empty,  others  ranging  from  near  empty  to  fiil. 
Samples  confirmed  the  presence  of  TCDD  from 
29  mg/kg  (ppm)  to  100  mg/kg  of  materials  in  the 
barrels  and  soils.  Based  on  the  field 
investigation,  excavation,  and  resiits  of  the 
sampling,  the  EPA  further  concluded  that 
immediate  action  was  necessary  to  protect 
human  health  and  the  environment.  This  decision 
necessitated  the  development  of  a short-term 
response  proyam  to  minimize  andlor  prevent 
the  release  of  contaminants  from  the  site  until  a 
method  permanently  ameliorating  the  hazard 
coifd  be  implemented.  An  immedate  and 
temporary  measure  was  taken  by  the  EPA  The 
dsposal  trench  was  capped  with  an  impermeable 
membrane.  Surface  water  was  dverted  from  the 
site.  At  this  point,  EPA  contracted  with  an 
independent  contractor  to  undertake  a three- 
month  study  to  determine  how  to  deal  with  the 
problem.  This  study  will  be  used  to  illustrate  the 
process. 

The  objective  of  the  study  was  to  dean  up  the 
site  or,  at  least,  to  ensure  It  would  not  impose 
risks  to  the  public.  As  a result  of  the  initial 
study,  it  became  evident  that  no  method  were 
presently  available  for  final  treatment  or 


disposed  which  met  even  minimum  criteria. 
Several  methods  were  in  the  experimental  stage, 
but  several  years  would  be  needed  to 
demonstrate  their  capability.  As  a resiit,  the 
following  conclusions  were  established: 

a.  There  is  no  method  for  final 
disposition  at  the  present  time; 

b.  Temporary  storage  is  required  uitii 
suitable  final  disposal  methods  are 
available. 

Four  general  alternatives  were  considered: 

1.  Leave  buried; 

2.  Leave  buried,  but  install  and 
maintain  a grouid  water  monitoring 
system; 

3.  Excavate  and  store  material  on-site 
in  a newly  (to  be)  constructed 
temporary  repository; 

4.  Excavate  and  transport  *ums  via 
truck  to  an  alternate  disposal  site 
(and  store). 

The  contractor  then  attempted  to  develop  the 
criteria  reqiired  for  each  remaining  alternative. 
Not  uiexpectedy,  the  risk  determination  caused 
the  most  significant  problem: 

"The  major  hazard  to  human 
health  due  to  the  wastes  at 
the  site  is  assumed  to  be  the 
toxicity  of  dioxin  (TCDD); 
for  simplicity,  only  this 
hazard  is  considered.  An 
"exposure'1  is  considered  to 
occur  whenever  a person 
comes  d recti y in  contact 
with  TCDD  in  high  enough 
concentrations  that  the  dose 
of  TCDD  to  his  body  exceeds 
an  assuned  safe  level,  which 
is  taken  to  be  1 part  per 
trillion  (ppt)  of  body  weijjit. 

The  levd  of  effect,  that  is, 
severity  of  health 
impairment,  produced  in  the 
exposed  person  by  this  dose 
of  TCDD  cannot  easly  be 
predicted,  and  therefore,  the 
person  is  counted  as 
potentially  subject  to  some 
adverse  health  effect. 

Dependng  on  the  actual 
magnitude  of  the  dose,  which 
In  turn  depends  on  time 
duration  of  the  contact  and 
other  pharmacological 

factors,  the  actual  level  of 
effect  stifered  may  range 
from  a mid  and  probably 
reversible  case  of  chi  or  acne 
to  cancer  of  the  liver. 

In  order  for  exposure  to 
TCDD  from  the  trench  at  the 


site  to  occur,  a certain 
amount  of  TCDD  must 
escape  from  the  trench, 
spread  from  the  site  via  some 
physical  environmental 
pathway  and  litimately  enter 
the  human  body  directly.  An 
effort  has  been  made  to 
systmatically  consider  all 
possible  pathways  and  to 
identify  those  exposure 
scenarios  which  are  most 
credible  for  four  alternative 
actions." 

At  this  point,  the  contractor  made  two 
assumptions  upon  which  his  analysis  was  based: 
Q)  since  human  risk  to  TCDD  cannot  be 
quantitatively  determined,  any  exposure  has 
negative  impact  and  that  impact  is  simply 
measurable  by  counting  the  number  of  people 
potentially  exposed  to  any  amount  of  TCDD 
from  the  site,  and,  (2)  the  probability  of 
expo  sire  scenarios  and  the  nunber  of  people 
potentially  exposed  coild  be  estimated. 

Table  1 summarizes  the  scenarios  which  were 
considered,  the  estimated  probability  of 
occurence  and  the  maximum  nunber  of  people 
exposed,  as  well  as  approximate  costs  of  each 
alternative  over  five  years.  The  exposure 
estimates  are  worst-case  estimates.  Table  2 
summarizes  the  data,  and  shows  the  res  tits  _gf 
the  expected  risk  computations  in  the  last  three 
columns,  i.e,  the  maximum  nunber  of  people 
exposed  miitiplied  by  the  probability  of 
occurrence  of  possible  events.  Alternative  3, 
the  most  expensive,  turns  out  to  have  the  lowest 
expected  risk,  but  only  by  a wry  small 
difference  at  the  third  significant  figure.  The 
rest  of  the  report  delineates  the  desip  criteria 
necessary  for  a facility  to  satisfy  this 
alternative.  It  is  obviously  not  the  cost-effective 
alternative;  but,  is  it  the  lowest  risk  alternative? 
Since  both  the  probability  and  consequence 
estimates  were  only  very  rough  estimates,  the 
reslits  of  this  approach  do  not  provide  very 
satisfactory  answers. 

The  difficulty  with  this  approach  is  that  all  the 
errors  aggregate  along  with  the  basic  data;  since 
they  are  large  and,  to  peat  extent, 
miiti  plica  live,  they  dominate  the  analysis.  This 
same  kind  of  problem  exists  in  all  bottom  up 
analyses,  especially  those  using  fatit  and  event 
tree  approaches  to  probabilistic  risk  analysis. 

Top-Down  Analysis  For  A Hazardous  Waste 
Decision 

One  cannot  do  a total,  In-depth  top-down  or 
bottom-up  risk  analysis  for  the  same  problem  — 
at  least  In  the  cases  studied  thus  far.  If  a 
bottom-up  analysis  has  already  been  done,  the 
top-down  analysis  looks  like  second  guessing 
(after  all  the  data  has  been  gathered).  In  reality 
this  happens;  in  fact,  the  analysis  undertaken 
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TABLE  1 

ABBREVIATED  SUHWY  OF  CREDIBLE  EXPOSURE  SCENARIOS 


Estimates  of 


Alternative  Action 

Probability  of 

Maximum  Number  of 

1 SW" 

A. 

SlNMHOLE  - CONTENTS  OF 

0.01 

1,446 

150  DRUMS  TO  GROUND  WATER 

P0P.-4.3  MILES  OF  SITE 

B, 

NO  SINKHOLE  - GRADUAL  LEAK  TO 

119 

GROUND  WATER 

0.90 

POP.-1.2  MILES  OF  SITE 

2.  Leave  buried 

A. 

Monitoring  systems  works  for 

0.98 

0 

Install  and  maintain 

BOTH  CASES  ABOVE 

MONITORING  SYSTEM  TOR 
GROUND  WATER  ($10,000) 

B. 

System  fails 

0.03 

379  - SINKHOLE 
119  - LEAK 

3.  Excavate  and  store  on 

A. 

CofMON  ACCIDENT 

0.20 

2-3  workers’ 

site  02,500,000) 

B. 

Tornado  strikes  during  operation 

3xl0'5 

50 

C. 

Leach  of  residuals  after  removal 

.95 

0 

D. 

Sinkhole  effect  on  residuals 

0.04 

67 

E. 

Worker  contaminated  by  human 

0.025 

40  WORKERS 

failure 

120  OFF-SITE 

4.  Excavate  and  Transport 

A. 

Same  as  a-e  above  for  alternative  3 

($1,500,000) 

B. 

Truck  accident  on  road 

3.5  x 10‘7 

1-2  WORKERS 

C. 

Truck  accident  at  facility 

3.5  x 10T7 

10  WORKERS 

TABLE  2 

SOmW  OF  ESTiriATED  RISKS 

MAXIM  A*  AVERAGE  IUKRS  OF  PEOPLE  EXPOSED  TO  EWCEROUS  CONCENTRATIONS  OF  TOD 


Al^armUvc  Rtoadial  Act  1 an 

cut  INC  SNORT  TCJtH 
Norton  Public 

an  aita  aff  aito 

CURING  LONG  TERM 
Norton  Public 
on  aita  off  alia 

Total 
an  Altt 

Total 

affjito 

Conbinrd 
Total  nwwrti 

1,  l««v*  turlad 

0 

U*4  >n 
14.44  at* 

0 

11?  nai 

107.10  ava 

0 

121.4  ava 

121.4  ava 

2.  Inatall  1 nalntatn  a yauntoatar 
aanttaclnf  ayataa 

0 

ST?  mm 
0.1  S ava 

0 

11?  mm 
SS.SS  ava 

0 

SS.7  ava 

SS.7  ava 

9.  tieavata  A at art  aatartal 
an  alto 

AS  aaa 
• 10.  A m 

170  mm 

H ava 

0 

47  mm 

2.7  ava 

20  ava 

27.7  ava 

A0.S  ava 

A.  (acavata  ♦ transact  tnaa  ala 
tract  la  Syntaa  facility  In 
Varan a,  No. 

AS  mm 

11.0  aw 

100  aw 

IS  ava 

0 

47  mm 

2.7  ava 

21.0  ava 

27.7  ava 

40.7  ava 

• m IN  wtM  wtar  aultlfl  lad  fey  IN  nIimIN  praNbillty  af  aecveraneat  in  Ttok  1-1 

fc  DanyirM*  ww  Kty  imu^  ta  Iaa4  ta  a too#  ^ p**  * «raatar  in  tha  wfiy  Ham*  featfyt  in  ••»«,  Ihia 

INt^aU  NNwtritw  la  0.0K  ppb. 
a TNrt  UnP  aaano  teiN  a»»wat ion  panto,  fynmatalr  1 MNtn. 

4 "lan§  Iwi*  naana  ffaalar  Una  1 jw  (aaawaaa  m a*  tor  futura  act  i ana  ana  taton  toito  M to  incraaato  victor  a^iawraa). 
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above  was  reanalyzed  by  an  informal  top-down 
analysis,  which  led  to  the  rejection  of  the  chosen 
alternative  and  the  adoption  of  a totally 
different  strategy.  However,  this  woiid  not 
serve  to  introduce  the  top-down  approach.  In 
cases  where  a top-down  approach  is  initially 
undertaken,  there  is  no  need  to  gather  all  the 
data  and  then  do  a bottom-up  analysis.  Thus,  the 
case  presented  here  is  merely  to  introduce  and 
illustrate  the  top-down  approach,  not  to  compare 
the  two  methods. 

This  case  involves  a large  chemical  company 
which  produces  hazardous  waste,  and  which  must 
find  the  means  to  dispose  of  these  wastes  in 
order  to  keep  their  primary  production  processes 
in  operation.  Neither  the  Environmental 
Protection  Agency  (EPA),  nor  local  authorities 
with  jurisdiction  over  land  fills  and  land  farms, 
have  issued  new  commercial  hazardous  waste 
site  permits  for  several  years.  The  existing 
capacity,  as  it  is  used  up  by  the  large  number  of 
waste  disposers,  can  res  tit  in  large  cost 
escalations  for  using  the  remaining  capacity. 
Moreover,  liability  for  fail  ire  of  hazardous 
waste  facilities,  under  the  Resource 
Conservation  and  Recovery  Act  (RCRA),  make 


all  participants  in  a site  liable  for  environmental 
and  health  impacts  for  disposal  system  failures, 
regard  ess  of  how  much  and  what  land  of  waste  a 
particular  disposing  organization  committed  to 
the  dsposal  site.  Other  details  will  be  brought 
out  in  the  dscussion. 

Top-Down  Risk  Analysis  Procedure 

Table  3 lists  the  procedural  steps  necessary  to 
undertake  a top-down  risk  analysis  and  Figure  I 
provides  a dagrammic  view  of  this  process. 
Each  step  will  be  explained  in  reference  to  the 
above-mentioned  problem. 

Step  it  Identify  a Minimum  Set  of  Critical 
Variables  — Initially,  five  critical  variables 
were  identified:  regulatory  climate  for 

obtaining  permits,  cost,  environmental 
damage  and  liability,  work  stoppage  and 
strike  potential,  and  transportation.  The 
last  two  were  found  to  be  of  lesser 
importance,  and  were  omitted  in  the 
minimization  process. 

Step  2:  Provide  Gross  Scales  for  these 

Variables  — Scales  of  high,  median  and 
low  were  used,  and  the  meaning  of 
each  classification  is  shown  in 
Appendix  1,  but  summarized  in  Table 
4. 


Step  3:  Generate  a Set  of  Scenarios  from 
the  Combination  of  the  Intersections  of  the 
Variable  Conditions  — There  are  th-ee 
variables,  each  with  three  levels  of  value, 
leading  to  27  separate  scenarios. 


TABLE  3 

TOP-DOWN  RISK  ANALYSIS 
PROCEDURAL  STEPS 

1.  Identify  a minimum  set  of  critical  variables 

2.  Provide  gross  scales  for  these  variables 

3.  Generate  a set  of  combination  scenarios  of  the  intersections  of  the  variable  conditions 

4.  Develop  a set  of  alternative  strategies  for  solution  and  a problem  structure 

5.  Identify  the  critical  decision  makers 

6.  Have  each  (or  group  of)  decision-maker  determine  his  choice  of  alternatives 

FOR  EACH  SCENARIO  OR  NEEDED  INFORMATION  TO  MAKE  A CHOICE 

7.  Identify  scenarios  in  which  decision-makers: 

A.  All  agree  as  to  selection  of  alternatives 

B.  Have  irresolvable  conflicts 

C.  Require  further  information 

8.  Find  means  to  resolve  conflicts,  if  possible.  If  not,  stop 

9.  Specify  and  conduct  required  studies  to  obtain  required  information 

a WHAT  INFORMATION 


a LEVEL  OF  PRECISION  REQUIRED 
a DECISION  POINT  - IF  KNOWN 

10.  Analyze  the  results 
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Scenario  Probabilities 
if  KnownI 


T" 


# 


Key  decision 

VARIABLES 

Alternative 

solutions 


Agreements 
Information  needs 
Conflict  


Conflict 

'resolution 


Figure  1< 


Diagrwiic  view  of  top-do*  risk  analysis  process. 


TABLE  4 

SOHART  Of  SCENARIOS 


SCENARIO 

OWNERSHIP 

1.  A.a.1 

2.  A.a.H 

3.  A.a.111 

Company 

Company 

Company 

4.  B.a.l 

5.  B.a.11 

6.  B.a.111 

Company 

Company 

Company 

7.  C.a.1 
B.  C.a.H 
9.  C.a.111 

Company 

Company 

Company 

10.  A.c.1 

11.  A.c.11 

12.  A.c.Hi 

Company 

Off-site 

Off-site 

13.  A.b.1 

14.  A.b.11 

15.  A.b.111 

Company 

Company 

Company 

16.  B.b.i 

17.  B.b.i  1 
IB.  B.b.i  11 

Company 

Company 

Undecided 

19.  B.C.1 

20.  B.C.11 

21.  B.c.Hi 

Company 
Off-site 
Off -site 

22.  C.b.l 

23.  C.b.11 

24.  C.b.111 

Company /Off-site 
Off -site 
Off-si te 

25.  C.c.l 

26.  C.C.11 

27.  c.e.m 


TECHNOLOGY 

UNO  (Cost  vs  Liability  Study) 

LF 

UNO  (Cost  vs.  Liability  Study) 
LF 

HT 

HT 

HT 

(Cost  vs.  Liability  Study) 

LF 

LF 

UNO  (Cost  vs.  Liability  Study) 

LF 

LF 

UNO  (Cost  vs.  Liability  Study) 

LF 

LF 


Difficult  to  9«t  permit 


Value  of  continuity 


UNO 

LF 

LF 
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This  combinational  problem  requires  that  the 
number  of  assigned  variables  and  values  be  kept 
low.  Scenarios  were  developed  for  each 
combination,  for  which  three  were  trivial  and 
eliminated.  The  scenarios  are  short  descriptions 
of  the  outcome,  and  only  two  are  reported  here 
to  provide  illustration  — the  rest  are  not 
induded  here  because  of  lack  of  space.  Note, 
that  at  this  step,  likelihoods  of  occurrence  have 
not  been  assigned  to  the  scenarios. 

Scenario  It  Optimistic  Regulatory 
Climate,  High  Cost  Escalation,  High 
Environmental  Impact  - A,a,i 

The  regiiatory  system  has  stabilized  and 
permits  are  obtained  with  reasonable 
effort.  However,  existing  capadty  for  the 
next  five  to  10  years  is  inadequate,  causing 
contractors  to  raise  disposal  costs  at  very 
high  levels  of  escalation.  Moreover,  the 
management  of  these  facilities  has  been 
less  than  adequate,  and  major  site  leaks 
can  be  expected  to  occur  at  one  or  more 
sites  involving  wastes  which  may  not  be 
the  company's,  but  which  are,  nevertheless, 
indistinguishable.  Thus,  the  company  coiid 
share  in  liabilities  resiiting  in  temporary 
and/or  permanent  dosure.  The  fact  that 
permits  are  easy  to  get  that,  in  the  long 
rtn,  competition  will  make  adequate 
capadty  available  at  reasonable  costs. 
The  timing  of  such  availability  in  the 
proper  locations  is  a key  issue  which  must 
be  compared  to  the  amortization  period  for 
any  company-owned  facility.  In  either 
case,  the  potential  for  high  environmental 
impact  by  land  fill  makes  the  high 
technology  operation  attractive  on  its  own. 

Critical  Factors; 

Years  to  high  capadty,  competitive 
contractors  availability  vs. 
amortization  period  of  hi£i 
technology  Investment. 

Cost  escalation  factor  and  estimate 
of  potential  liability  vs.  cost  of  high 
technology  alternative. 

Scenario  2>  Optimistic  Regulatory 
Climate,  High  Cost  Escalation,  Median 
Environmental  Impact  - A,a,U 

This  scenario  is  similar  to  Scenario  1, 
except  that  the  environmental  Impact  and 
attendant  liability  is  peatly  reduced.  The 
higi  cost  escalation  In  the  short  rut  makes 
contractor  ownership  unattractive  and  tne 
company  can  obtain  permits  for  their  own 
land  fills. 

Critical  Factors] 

Increased  cost  of  high  technology 
operation  vs.  land  fills  must  be 


compared  to  cost  escalation  factors 
and  potential  ' liability  of  medium 
environmental  impact. 

The  company  ownership  decision  is 
also  dependent  on  the  years  to  high 
capadty,  and  competitive 
:ontractors  availability  vs.  the 
amortization  period. 

Step  0:  Develop  a Set  of  Alternative 

Strategies  for  Solution  and  a Problem 
Structure  — The  following  three 
alternative  strategies  have  been  proposed: 

1.  Hirfi  Technology  Facility  - HT 
On-site 

Objective:  Maximize  destruction  of 

waste 

Indnerator  and  other  processes 
Minimum  land  disposal 
High  investment 
Company  owned  ?nd  operated 

2.  Off-Site  Disposal  (cirrent)  - LF  Off- 
site 

Land  intensive 
Off-site 

Land  farming  — land  fill 
Low  investment 
Contracted 

3.  Company  Land-based  System  - LF 
Company-owned 

Land  intensive 
On-site 

Company  operated  and  owned 
Indnerate  some  wastes 

The  problem  is  basically  a sequence  of  two 
dedsions  plus  some  contingency 
alternatives  in  the  face  of  uncertainty  In 
several  critical,  ^controlled  states  of  the 
regulatory  environment. 

Dedsion  Level  One:  Use  contractor 
waste  facilities  or  develop  and 
operate  company-owned  facilities. 

Dedsion  Level  Two:  If  the  company 
develops  553  operates  Its  own 
facility,  should  It  be  a land  fill 
operation  or  a high  technology 
operation? 

Contingency  Alternatives 

1.  Level  One:  Contractor  Facility 
—S  ho  lid  the  company  develop  a 
land  fill  site  for  use  as  a 
contingency  if  contractor 
operations  are  to  be 
intenrupted? 

2.  Level  Two:  Company- owned 

Land  Fill  Operation  — How 
many  such  sites  are  there,  and 
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where  stolid  they  be  located? 

3.  Level  Two:  Company-owned 

High  I'echnaioKy  Operation" 
What  kind  erf  technology, 
capacity,  and  location  is 
required?  Stolid  remaining 
iand  fill  needs  be  fulfilled  by 
the  company  on-site,  by  a 
contractor,  or  by  some 
combination  of  these? 


Environmental 

Department 


Legal  Department 


Environmental 
requirements 
and  relations 
with  Federal, 
state  and 
iocal  agencies 

Liability 
and  legal 
ramifications 


This  decision  problem  is  illustrated  in 
Figure  2.  It  stolid  be  noted  that  Level  i 
and  Level  2 decisions  are  not  totally 
decoupled  since  the  cost  of  technology,  and 
its  performance  capability  at  Level  2, 
affects  the  choice  of  Level  1,  ia.,  the 
choice  between  contractor  or  company 
ownership. 

Uval  2 Und  HI 


Risk  Analysis  Team 


Kuabor  and 
Location 
of  Sica* 


Technology 
Land  fill/  ’ 
High 

Technology 


High  Technology 


(Wturshlp 

' \ 
Coupling  of 

■>M  of 

Technology  I 

and  Coot 

femorship  of 

koaolnlog 
Load  Pills 

Ceapujr/ 

Contractor* 

Uvol  1 aad  2 

\ 

Contractor 


Team  responsible 
for  conducting 
the  analysis 
and  making 
day-to-day 
decisions 


rtgata  t Tree  at roc tore  of  the  doc la loo  problen. 


Ha  Contingency 
fit* 


Step  3:  Identify  the  Decision  Makers  — 
There  are  many  decision  makers,  but  the 
division  manager  will  make  the  final 
judgnent.  The  array  at  decision-makers 
are  at  follows: 


Division  Manager  Final  decision 

responsibility 


Production  M anagem  ent 


Need  for 
con  tin  lit  y 
of  capacity 


Engineering 

Management 


Dcalgi  of 
on-site  waste 
facilities 
and  hazardous 
waste  stream 
identification 


Step  6i  Have  each  (or  group  of)  decision 
mater  determine  his  choice  at  alternatives 
for  each  scenario  or  the  Information 
required  In  order  to  make  a choice.  The 
results  of  this  effort  are  shown  In  Table  4 
for  each  of  the  27  scenarios.  Each 
scenario  Is  assigned  a number  in  column  1, 
identified  by  the  coded  combinations  as 
shown  In  column  2.  Column  3 shows  the 
ownership  decision,  colunn  4,  the 
technology  decision  or  Information 
required  to  make  the  decision. 

Step  7:  Identify  Scenarios  in  which 

Decision-Makers:  (a)  ail  agree  as  to  the 
selection  of  alternatives)  (b)  have 
Irresolvable  value  conflicts;  (c)  require 
further  Information.  In  this  case,  no 
conflicting  situations  were  foend  which 
co lid  not  be  resolved)  however,  two  studes 
(a  cost  vs.  liability  study  and  permit 
difficulty  vs.  value  of  contintity  study) 
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were  identified  for  the  wdecided  cases, 
Uf ID,  for  the  technology  decision.  The  one 
wdecided  case  for  the  ownership  decision 
is  only  for  landfills  and  is  a lower  level 
decision. 

Step  8;  Find  Means  to  Resolve  Value 
Conflicts  — There  were  no  value  conflicts 
which  co lid  not  be  resolved  in  order  to 
select  the  preferred  alternative  for  a given 
scenario,  except  for  the  outcome  of  the 
two  studies  to  be  conducted.  Some 
un resolvable  conflicts  can  be  eliminated  if 
the  probablity  for  a scenario,  where  a 
conflict  exists,  is  so  low  as  to  be  of  little 
concern.  The  probability  of  a scenario 
depends  upon  the  joint  probability  of  each 
value  for  each  scale.  Approximate 
probability  classes  are  tsualiy  adequate  for 
this  purpose  as  long  as  the  participants  in 
making  assignments  understand  and  agree 
on  the  meaning  of  such  assignments 
(precision  of  the  scale),  although  the 
choice  at  values  may  differ  (accuracy  of 
the  measurement).  Classes  and  probability 
values  might  be  assigned  as  follows: 


Value  Probability  Probability 

Assigiment  Range  Va*ue 

Used 

H10t  0.8-1.00  0.9 

Moderate  0.2-0.8  0.3 

Low  0.01 -0.2  0.1 

Very  Low  Less  than  at  0.01 


The  joint  probability  of  the  values  of  the 
critical  parameters  are  found  by 
multiplying  the  three  values  together,  one 
for  each  parameter,  to  obtain  the 
probability  a!  the  scenario.  Probabilities 
less  than  one  in  a thousand,  with  respect  to 
the  highest  probability  scenario,  might  be 
considered  Insignificant  (if  the 
consequences  are  catastrophic  even,  lower 
probabilities  should  be  considered).  Note: 
in  the  top-down  approach,  this  is  the  only 
method  in  which  probabilities  are  tied, 
i«.,  the  probability  of  a scenario 
occurring. 

If  wresdvable  value  conflicts  survive  at 
this  stage,  no  further  technical  studies  will 
aid  in  resolving  the  conflict.  A decision 
involving  political  power  is  the  only  way  to 
resolve  such  issues. 

Step  9:  Specify  and  Conduct  Studies  to 
Obtain  Required  Information  — Two 
studies,  described  in  Step  7,  mist  be 
specified,  and  then  carried  out.  In  each 
case,  the  required  information  mist  be 
identified,  as  well  as  the  level  of  precision 
of  the  required  information,  and  the 
decision  point,  if  it  is  known. 


Cost  vs.  Liability  Study  — Since  the  high 
technology  option  involves  higher  capital 
and  operating  costs  than  the  lowest 
techno! gy  options,  these  costs  must  be 
offset  by  a significant  reduction  in 
liability.  It  was  determined  that 
engineering  estimates  for  capital  and 
operating  costs  only  had  to  be  precise  to 
one  siguficant  figure,  and  that  time 
discounting  of  money  flow  was  not 
required.  The  cost  estimates  for  contractor 
facilities  are  already  provided  in  the 
parameter  scales  (shown  in  Appendix  1). 
Using  similar  cases  and  trends,  the  legal 
department  made  estimates  of  possible 
levels  of  liability  for  a range  of  impacts 
for  each  alternative.  These  estimates 
were  only  necessary  to  an  order  of 
magnitude  of  one  significant  figure  for 
very  large  suns  of  money.  In  addition,  the 
legal  department  made  a relative  risk 
estimate  of  the  likelihood  of  liability 
dal  ms  from  each  alternative  to  about  one 
order  of  magnitude.  No  derision  points 
were  developed  for  this  study,  except  to 
express  the  scarcity  of  capital  funds. 

Difficulty  of  Getting  a Permit  vs.  Value  of 
Continuity  Study  — This  was  a two-part 
study  aimed  at  how  long  the  production 
operation  could  run  if  no  land  fill  capacity 
was  available,  and  what  short  term  fixes 
could  be  undertaken,  such  as  Interim 
permits  or  special  appeals.  These  studies 
were  strategic,  rather  than  tactical,  and 
were,  except  for  the  production  rin  time 
to  shutdown,  qualitative  in  nature. 

Step  10:  Analyze  the  Results  — The 

resists  at  these  studies  are  then  added  to 
the  analysis.  The  format  for  the  results  of 
the  cost  vs.  liability  study  is  shown  in 
Table  3.  This  is  then  used  to  perform  an 
indifference  analysis  as  shown  In  Table  6. 
This  indifference  analysis  shows  the 
probability  balance  point  where  the  actual 
estimate  of  probability  of  scenario 
occurrence  is  compared,  ieadng  to  a 
choice  of  one  scenario  over  the  other.  The 
indifference  probability  is  the  calculated 
derision  point  as  opposed  to  the  specified 
decision  point  (if  it  is  specified  a priori). 

In  addition,  the  relative  likelihood  of  costs 
and  libilities  can  be  found,  as  shown  in 
Table  7.  Note  that  the  numeric  results  of 
the  analysis  are  not  given,  since  the  actual 
values  used  were  proprietary.  A similv, 
but  abbreviated  analysis,  was  conAicted 
for  the  second,  yet  qjalitative  study. 

Aii  the  surviving  scenarios  are  then 
grouped  by  the  three  alternatives,  and  the 
sum  of  the  probabilities  at  the  scenarios 
ieading  to  each  alternative  is  determined. 
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This  is  the  probability  of  selecting  that 
alternative  and  having  made  the  right 
decision.  A "what  if"  analysis,  as  r,hown  in 
Table  8,  can  then  be  used  to  determine  the 
cost  of  being  wrong.  The  decision  is  made 
by  maximizing  the  correctness  end 
minimizing  the  cost  of  being  wrong.  A 
dominant  solution  is  one  whose  probability 


of  being  correct  is  hitter  and  whose  cost 
of  being  wrong  is  lower  than  another 
alternative,  which  is  dominant.  For  the 
case  involving  multiple  dominant 
strategies,  the  propensity  for  risk  of  the 
decision  maker  can  be  considered  in  terms 
of  minimax  or  maximin  choices. 


TABiE  s 
ANALYSIS  1 

COSTS  AND  ENVIRONMENTAL  LIABILITY 


PROBABILITY 


ALTERNATIVES 

COST 

PROJECTIONS 

SIZE  OF 
LIABILITY 

OF  ENVIRONMENTAL 
DAMAGE 

Hip 

Mod 

Low 

Hip 

Med 

Low 

Company -Land  Fill 

Cll 

C1J 

cu 

LI1 

LIJ 

LI3 

P, 

Company- Land  Farm 

=21 

=22 

C23 

hi 

4z 

L23 

% 

Company  - Incinerator 

C). 

=32 

=33 

hi 

L32 

L33 

P3 

Contractor  - Land  Fill 

C*1 

C42 

C43 

hi 

L*Z 

L«J 

% 

Cm  and  Uakilitiat  in  Qvar  the  Operetinj  Lil«  at  Dm  Fa-iUtla*  - Uahillllaa  Cm  Extend  Firthor. 


T » 

STEP  1 Indifference  Analysis  1 (continued) 

Pq  is  the  probability  op  damage  claims  of  a contractor  landfill  over  its  life.  We  do  not 
xnom  the  value  of  pj,  exactly.  We  do  have  some  estimates  of  relative  risk  of  the  other  options 

Aj  IS  the  relative  improvement  in  reliability  due 

TO  COMPANY  TOTAL  CONTROL  OVER  A LAND  FILL. 

Aj  IS  THE  RELATIVE  IMPROVEMENT  IN  RELIABILITY  OF 
A LAND  FARM  OVEN  A LAND  FILL. 

Aj  IS  THE  IMPROVEMENT  OF  AN  INCINERATOR  OVER  A LAND  FARM. 


The  indifference  probability  is  fowd  by  takinb  any  tno  options  and  C,j  ♦ p,L, j * ♦ p^L^j 

(Note:  Pq  must  almays  be  positive,  i.e..  higher  cost  cases  must  have  loner  liability  expectation.) 
This  can  be  solvid  for  all  combinations  of  Cost  and  Liabilities  to  find  the  ranse  of  decision 

VALUES  OF  Pq  FOR  EACH  COMBINATION  OF  ALTERNATIVES.  I.E..  NINE  CONDITIONS  FOR  EACH  COMPARISON  OF 
ALTERNATIVE!. 


IN  RELATION  TO  P(j.  I.E.. 

Pi  ’ *1% 

Pj  ■ A2Pj 
Pj-AjPj 

Pi  ■ AjP4  ■ Ajlf, 

f 2 ■ *1*2%  ■ *20% 

% ’ *1*2* J%"  *J0% 
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TABLE  7 

STEP  2 Relative  Likelihood  of  Costs  and  Liabilities  Analysis  (continued) 


If  information  on  the  relative  likelihood  of  costs  are  available,  then  an  average  cost 

CALCULATION  COULD  BE  TRIED. 

CI  ” BllCll  + Bi2Ci2  + Bi3Ci3  WHERE  B[1  +Bi2  +*i3  -1 

A SECOND  METHOD  IS  TO  ORDER  THE  NINE  CALCULATIONS  IN  ORDER  OF  THEIR  RELATIVE  LIKELIHOOD 
WITH  A CALCULATION  BESIDE  EACH  SHOWING  THE  RELATIVE  LIKELIHOOD. 


This  can  also  be  done  for  liabilities,  such  that 

Li  ■ cilLil  + ci2li2  + ci3li3  where  cil  + ci2  + ci3  " 1 
Then,  when  ordered  by  relative  likelihood,  the  order  is  calculated  by  buckl. 


TABLE  8 
ANALYSIS  3 
WHAT  IF?  ANALYSIS 

The  costs  or  opportunities  involved  in  selecting  an  alternative  i based  upon  more 
favorable  conditions  for  alternative,  k (see  Analysis  1). 


WI C i k, jl  ■ cu  • CK  - (lKL  - L, j)  + Other  Costs,  if  any. 
There  are  no  probabilities  involved  since  the  scenario  happens. 


There  are  9 x 6 • W such  combinations.  But,  only  those  combinations  made  feasible 

BY  A CHANGE  IN  REGULATORY  CLIMATE  OR  SITING  CLIMATE  SHOULD  BE  INVESTIGATED.  MOREOVER, 
AFTER  A SPECIFIC  ALTERNATIVE  IS  CHOSEN,  THE  WHAT  1FS  REDUCE  TO  9 X 3 • 27. 


! 
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In  each  case,  the  studies  which  were  uidertaken 
were  relatively  imprecise  estimates  made  by 
knowledgeable  personnel  with  a minimim  of 
expended  resources  for  acquiring  data.  The 
subsequent  manipulation  of  the  data  was  to 
extract  the  maximun  available  Information  from 
it.  The  indifference  analysis  provided  the 
decision  point  where  the  probability  estimates  of 
scenarios  could  be  ascertained.  Emerging 
dominant  strategies  force  a decision.  In  other 
cases,  the  final  choice,  involving  the  propensity 
for  risk  of  the  decision  maker,  is  presented  in 
decision-making  terms  which  decision  makers  at 
all  levels  can  understand. 

The  dominant  feature  of  the  approach  is  to 
focus,  very  early,  on  the  critcal  decision  factors 
and  only  obtain  bottom-ip  type  data  for  the 
UND  conditions  to  a limited  level  of  precision 
and  a limited  data  gathering  effort.  The  use  and 
m ampliation  of  data  for  maximum  information 
for  the  decision  is  stressed  rather  than  acquiring 
data  before  its  utility  in  the  decision  process  is 
ascertained.  Gathering  precise  data  Is 
expensive,  manipiiating  small  amounts  of 
imprecise  data  is  not. 

A major  advantage  of  the  approach  is  that  it 
forces  the  decision  analyst  to  communicate  with 
the  decision  participants  in  mutually 

understandable  language.  This  is  accomplished 
by  developing  understandable,  mutually  exclusive 
and  collectively  exhaustive,  and  descriptive, 
scale  values,  outcome  scenarios,  alternatives, 
and  probability  assignments.  This  process  Is 
built  in,  and  may  be  the  most  usefid  aspect  at 
the  approach 

On  the  other  hand,  the  process  Is  desired  for 
organizations  whose  various  facets  have  the 
same  objectives  yet  different  perspectives  on 
how  best  to  achieve  these  objectives.  The 
identification  of  conflicts  for  outcome  scenarios 
can  otherwise  bring  out  hidden  agendas.  For 
organizations  which  have  goal  conflicts  and 
Internecine  antagonisms,  this  process  might  be 
quite  upsetting. 

Use  of  the  Top  Down  Approach  In  the  Defense 
Department  Acquisition  Process 

Because  the  process  is  top-down,  Its  use  must  be 
made  In  the  same  manner,  14,  starting  from  the 
top.  It  will  best  be  used  at  the  be  ginring  of  the 
acqusltion  In  order  to  determine  performance, 
cost,  and  schedtfe  requireme.ts  for  all  users, 
many  of  whom  may  have  conflicting 
requirements  (as  opposed  to  conflicting  agendas). 
Conflicting  requirements  can  be  evidenced  by 
developing  scenarios  for  different  outcomes  of 
performance  level,  schedule  and  cost 
combinations,  and  a range  of  alternatives. 
Conflicting  agendas  may  become  visible,  and  this 
may  either  help  to  provide  compromises  or 
exacerbate  the  situation. 


The  top-down  approach  promises  a better 
rapport  between  the  users,  decision  analyst,  and 
decision  makers.  This  promise  can  only  be 
ascertained  by  attempting  to  use  it  on  several 
tests  or  real  cases. 


Footnotes 

* "Technical  Study  and  Remedal  Action  for 
Denny  Farm  Site  i,  Aurora,  Missouri  "(Final 
Report),  Docunent  No.:  EFSR80-09-S05,  TDD: 
F7-8006-Oi,  EPA  Contract  No.:  68-01-6056, 
Ecology  and  Environment,  Inc.,  September  15, 
1980,  p B-i. 


APPENDIX  I 

MEANING  OF  VALUE  ASSIGNMENTS  TO 
CRITICAL  VARIABLES 

1.  THE  REGULATORY  CLIMATE  FOR 

ALLOWING  PERMITS  POR  HAZARDOUS 
WXSTFSiTEg 

The  Environmental  Protection  Agency, 
under  RCRA,  is  responsible  for  permitting 
hazardous  waste  disposal  sites.  This,  in 
turn,  can  be  modified  by  state  and  local 
regulations  and  pressures.  Three  different 
scenarios  exist  for  alternate  regiiatory 
conditions  In  the  future.  At  the  present 
time,  the  outlook  for  permits  Is  very 
confusing  and  obtaining  permits  Is  very 
difflcift.  EPA  is  In  a transition  status  and 
a permitting  program  with  definitive 
criteria  does  not  yet  exist.  Obtaining  new 
permits  under  the  present  case  Is  either 
difflcift  or  non-existent. 

CASE  Ai  Optimistic  Outlook 
EPA  comes  out,  in  the  very  near  future, 
with  reasonable  regulations  and  criteria  for 
obtaining  permits  for  hazardous  waste 
sites.  The  criteria  may  be  exacting  and 
sometimes  dfflctit  to  achieve,  but  the 
means  for  meeting  the  criteria  are 
unambiguous  and  straightforward  and, 
when  met,  permits  are  issued.  Permitting 
co lid  even  be  easier  to  obtain  than 
Indicated  above,  Le,  the  dimate  coif  d be 
even  more  optimistic,  but  this  would  not 
have  much  affect  on  the  decision  criteria 
here. 

CASE  Bi  Less  Pessimistic  Outlook 
EPA  regulations  on  permits  and  criteria  for 
obtaining  permits  a re  issued,  but  the  means 
for  meeting  the  criteria  are  ambiguous, 
hard  to  predict,  lengthy,  and  unduly  subject 
to  public  and  other  pressures.  Permits  can 
be  obtained,  but  the  predictability  of  when, 
and  under  what  conditions,  permits  are 
issued  is  uncertain.  Howpver,  the 
regUatory  dimate  is  improved  over  the 
present  situation. 


CASE  C:  Pessimistic  Outlook 
The  present  situation  continues.  Permits 
are  nearly  impossible  to  obtain  and  the 
confused  conditions  remain,  at  le«*.,  for 
the  next  few  years. 

2.  COST  ESCALATION  OF  CONTRACTOR 
DISPOSAL  FEES 

Contractor  disposal  fees  are  boind  to 
escalate  when  there  Is  inadequate  capacity 
for  disposal,  such  as  at  present.  Unless  the 
disposal  field  becomes  intensively 
competitive  for  wastes  of  the  type  the 
company  produces,  it  is  unlikely  that 
contractor  costs  for  disposal  will  be 
reduced. 

CASE  a:  Hifdi  Cost  Escalation 
Costs  of  disposal  escalate  at  rates  which 
are  increasing  fast  enough  to  offset  the 
investment  costs  in  the  high  technology 
operation.  At  the  present  status  of  this 
study,  the  investment  and  operating  costs 
have  not  yet  been  ascertained,  nor  are  the 
present  escalation  rates  greater  than  50% 
per  year.  However,  this  scenario  accepts 
that  upon  completion  of  cost  studes 
escalation  will  exceed  the  high  technology 
investment  costs,  making  such  Investment 
feasible  on  an  economic  basis  alone. 

CASE  lx  Moderate  Cost  Escalation 
The  costs  escalate  at  a rate  more  than 
enough  to  offset  the  costs  of  Investment 
and  operation  for  a company  land  fill 
operation  (cost  yet  to  be  determined),  but 
not  nearly  enough  to  offset  the  high 
technology  case. 

CASE  C;  Low  Cost  Escalation 

The  costs  escalate  at  or  near  the  Inflation 

rate.  This  Is  quite  different  than  present 

trends. 

3.  ENVIRONMENTAL  DAMAGE  AND  LIABILITY 

Whether  at  a contractor  site  or  a company 
site,  accidents  or  leala  occur  requiring 
remedal  action,  fines,  and/or  liability 
dal  ms. 

CASE  fa  Hl«h  Environmental  Impact 
Occurs 

A major  off-site  leak  or  accident  occurs 
which  represents  a serious  departure  from 
requirements.  Costly  remedal  actions, 
fines,  and  liability  for  the  off-site  public 
may  be  Involved.  In  addition,  negative 
publldty  may  affect  corporate  image  and 
may  res  (it  ,n  site  das  ire  or  restrictions. 

CASE  lb  Moderate  Environmental  Impact 
Occurs 

Leaks  and  accidents  occur  on- site  with 
minor  off-site  problems.  Remedal  actions 


may  be  necessary  and  fines  may  be  levied, 
but  liability  would  be  minimal.  Adverse 
pubiidty  and  pressures  on  site  operation 
might  occir . 

CASE  iiit  Negligible  Environmental  Impact 
Occurs 

The  site  performs  to  requirements  and  all 
acddents  and  leaks  are  retained  on-site, 
using  normal  procedures.  Problems  occur, 
but  are  within  the  normal  scope  of 
operations. 

4.  SITE  CLOSURE  SUSCEPTIBILITY 

This  variable  is  important,  but  only 
becomes  critical  after  the  first  three 
variables  have  been  determined.  There  are 
two  cases:  susceptible  and  less 

susceptible.  Some  of  the  reasons  for 
dosure  are  regulatory  changes,  loss  of 
permit,  strikes,  public  pressure  for  dosure, 
and  capacity  limit  reached.  For  each  of 
these  reasons  the  choices  of  Level  1 and  2 
decisions  become  more  or  less  susceptible 
to  dosure.  Only  differences  among 
alternatives  need  be  considered. 

5.  TRANSPORTATION  OF  WASTES 

Transportation  of  wastes,  some  of  which 
may  be  hazardous,  becomes  a problem  in 
only  two  respects:  (I)  Interruption  of 

transportation  by  state  or  local 
governments,  strikes,  etc.,  and  (2)  long 
distances  to  travel  which  provide  exposure 
for  acddents  and  higher  transportation 
costs.  The  basis  of  the  transportation 
dedsion  factors  is  whether  there  are  single 
or  rmitipie  waste  sites  and  their  locations. 
The  comparative  transportation  problem  Is 
made  by  comparing  the  distances  and 
routes  among  the  technical  alternatives 
and  determining  the  relative  differences  In 
distance  and  localities  and  state  lines 
crossed.  The  risks  of  transport  per  mile 
are  low,  but  can  be  assessed  as  an 
additional  parameter  for  consideration  as 
will  the  costs. 
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